The effect of negative valence on false memory formation in the Deese-Roediger-McDermott paradigm: A preregistered meta-analysis and preregistered replication.

Participants in the Deese-Roediger-McDermott (DRM) paradigm learn lists of words (e.g., bed, tired) associated with a nonpresented lure (i.e., sleep). In subsequent memory tests, individuals tend to report the nonlearned lures, that is, exhibiting false memories. Priorly, the DRM task has been criticized for not capturing the aversive nature of (clinically and forensically relevant) real-life memories. To obtain a robust estimate of the influence of negative versus neutral word lists on the DRM effect, we conducted both a preregistered meta-analysis (krecall = 49, nrecall = 2,209, krecognition = 75, nrecognition = 3,008, kresponsebias = 31, nresponsebias = 1,128) and replication (nfinal = 278) predicting increased false memories for negative valence in recall and recognition. For recall, we found significant frequentist evidence in the meta-analysis for a reversed valence effect (d = -0.18, i.e., reduced false memories for negative content vs. neutral), whereas the replication displayed null results (d = 0.03). For recognition, both the meta-analysis (d = 0.23) and replication (d = 0.35) showed that negative valence (vs. neutral) increased false memories. However, this effect may be confounded by shifts in response tendencies as controlling for response bias nullified the valence effect in our meta-analysis (dmeta = 0.05), and we found evidence for differential response bias in our replication (dreplica = 0.39). Hence, the effect of valence on false memory reports in the DRM may not represent a systematic difference in emotional information but instead depend on how memory is tested, and be partly attributable to differential response tendencies. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Diagnosing eyewitness identifications with reaction time­based Concealed Information Test: the effect of viewpoint congruency between test and encoding.

Mistaken eyewitness identifications continue to be a major contributor to miscarriages of justice. Previous experiments have suggested that implicit identification procedures such as the Concealed Information Test (CIT) might be a promising alternative to classic lineups when encoding conditions during the crime were favorable. We tested this idea by manipulating view congruency (frontal vs. profile view) between encoding and test. Participants witnessed a videotaped mock theft that showed the thief and victim almost exclusively from frontal or profile view. At test, viewing angle was either congruent or incongruent with the view during encoding. We tested eyewitness identification with the RT-CIT (N = 74), and with a traditional simultaneous photo lineup (N = 97). The CIT showed strong capacity to diagnose face recognition (d = 0.91 [0.64; 1.18]), but unexpectedly, view congruency did not moderate this effect. View congruency moderated lineup performance for one of the two lineups. Following these unexpected findings, we conducted a replication with a stronger congruency manipulation and larger sample size. CIT (N = 156) showed moderate capacity to diagnose face recognition (d = 0.63 [0.46; 0.80]) and now view congruency did moderate the CIT effect. For lineups (N = 156), view congruency again moderated performance for one of the two lineups. Capacity for diagnosing face recognition was similar for lineups and RT-CIT in our first comparison, but much stronger for lineups in our second comparison. Future experiments might investigate more conditions that affect performance in lineups vs. the RT-CIT differentially.

Assessing partial errors via analog gaming keyboards in response conflict tasks: A proof-of-concept study with the concealed information test.

The response time-based Concealed Information Test (RT-CIT) is an established memory detection paradigm. Slower RTs to critical information (called 'probes') compared to control items (called 'irrelevants') reveal recognition. Different lines of research indicate that response conflict is a strong contributor to this RT difference. Previous studies used electromyography (EMG) to measure response conflict, but this requires special equipment and trained examiners. The aim of this study was to explore if response conflict can also be measured with an analog gaming keyboard that is sensitive to minimal finger movements. In a preregistered study, participants completed an autobiographical RT-CIT (n = 35) as well as a cued recognition task (modified Sternberg task; n = 33) for validation purposes. Partial errors, partial button presses of the incorrect response key, were more frequent in trials with response conflict than in trials without conflict. Partial errors were rare (CIT: 2.9%; Sternberg: 1.7% of conflict trials), suggesting analogue keyboards have lower sensitivity than EMG. This is the first evidence that analog keyboards can measure partial errors. Although likely less sensitive than EMG measures, potential benefits of analog keyboards include their accessibility, their compatibility with all tasks that use a standard keyboard, that no physical contact with the participant is needed, and ease of data collection (e.g., allowing for group testing).

The role of response conflict in concealed information detection with reaction times.

The concealed information test (CIT) presents various probe (familiar) items amidst irrelevant (unfamiliar) items. When the probe items appear, reaction time (RT) slows down. This RT-CIT effect has been accounted for by a conflict resulting from the need to deny familiarity of the familiar probes. The present pre-registered study (n = 292) examined whether response conflict is sufficient to account for the RT-CIT effect, using city and name items. Specifically, we compared the common conflict condition, where the response buttons emphasized familiarity of CIT items ("unfamiliar" versus "familiar"), to a novel no conflict condition, where the buttons emphasized categorical membership ("city" versus "name"). In line with our expectations, the RT-CIT effect was substantially stronger in the conflict condition; yet, it remained significant even in the no conflict condition. This implies a critical role for response conflict, but also suggests that other mechanisms (e.g. orientation to significant stimuli) may contribute to the RT-CIT effect.

The validation of online webcam-based eye-tracking: The replication of the cascade effect, the novelty preference, and the visual world paradigm.

The many benefits of online research and the recent emergence of open-source eye-tracking libraries have sparked an interest in transferring time-consuming and expensive eye-tracking studies from the lab to the web. In the current study, we validate online webcam-based eye-tracking by conceptually replicating three robust eye-tracking studies (the cascade effect, n = 134, the novelty preference, n = 45, and the visual world paradigm, n = 32) online using the participant's webcam as eye-tracker with the WebGazer.js library. We successfully replicated all three effects, although the effect sizes of all three studies shrank by 20-27%. The visual world paradigm was conducted both online and in the lab, using the same participants and a standard laboratory eye-tracker. The results showed that replication per se could not fully account for the effect size shrinkage, but that the shrinkage was also due to the use of online webcam-based eye-tracking, which is noisier. In conclusion, we argue that eye-tracking studies with relatively large effects that do not require extremely high precision (e.g., studies with four or fewer large regions of interest) can be done online using the participant's webcam. We also make recommendations for how the quality of online webcam-based eye-tracking could be improved.

Correction to: 'Raising the value of research studies in psychological science by increasing the credibility of research reports: The Transparent Psi Project' (2023) by Kekecs et al.

[This corrects the article DOI: 10.1098/rsos.191375.][This corrects the article DOI: 10.1098/rspb.2022.2500.].

Are Speeded Tests Unfair? Modeling the Impact of Time Limits on the Gender Gap in Mathematics.

When cognitive and educational tests are administered under time limits, tests may become speeded and this may affect the reliability and validity of the resulting test scores. Prior research has shown that time limits may create or enlarge gender gaps in cognitive and academic testing. On average, women complete fewer items than men when a test is administered with a strict time limit, whereas gender gaps are frequently reduced when time limits are relaxed. In this study, we propose that gender differences in test strategy might inflate gender gaps favoring men, and relate test strategy to stereotype threat effects under which women underperform due to the pressure of negative stereotypes about their performance. First, we applied a Bayesian two-dimensional item response theory (IRT) model to data obtained from two registered reports that investigated stereotype threat in mathematics, and estimated the latent correlation between underlying test strategy (here, completion factor, a proxy for working speed) and mathematics ability. Second, we tested the gender gap and assessed potential effects of stereotype threat on female test performance. We found a positive correlation between the completion factor and mathematics ability, such that more able participants dropped out later in the test. We did not observe a stereotype threat effect but found larger gender differences on the latent completion factor than on latent mathematical ability, suggesting that test strategies affect the gender gap in timed mathematics performance. We argue that if the effect of time limits on tests is not taken into account, this may lead to test unfairness and biased group comparisons, and urge researchers to consider these effects in either their analyses or study planning.

No impaired integration in psychopathy: Evidence from an illusory conjunction paradigm.

Progress in psychopathy research has been hampered by ongoing contention about its fundamental cause. The Impaired Integration theory of psychopathy provides an attention-based account of information integration abnormalities. We set out to evaluate the suggested mechanism via an innovative application of the well-established illusory conjunction paradigm. Two hundred participants were recruited by utilizing a psychopathic-trait-maximization technique, sampling individuals from an ex-prisoner and a population sample. We found no support for information integration deficits in psychopathic individuals (BF10 = 0.156), and the absence of a relationship between psychopathic traits and illusory conjunctions remained when accounting for confounding variables. These findings question the mechanism proposed by the Impaired Integration theory and pave the way for future research to advance our understanding of psychopathic trait etiology by assessing specific and falsifiable mechanisms thought to bring about the observed cognitive and behavioral deficits. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Suppression-induced forgetting: a pre-registered replication of the think/no-think paradigm.

Post-traumatic stress disorder is characterised by recurring memories of a traumatic experience despite deliberate attempts to forget (i.e., suppression). The Think/No-Think (TNT) task has been used widely in the laboratory to study suppression-induced forgetting. During the task, participants learn a series of cue-target word pairs. Subsequently, they are presented with a subset of the cue words and are instructed to think (respond items) or not think about the corresponding target (suppression items). Baseline items are not shown during this phase. Successful suppression-induced forgetting is indicated by the reduced recall of suppression compared to baseline items in recall tests using either the same or different cues than originally studied (i.e., same- and independent-probe tests, respectively). The current replication was a pre-registered collaborative effort to evaluate an online experimenter-present version of the paradigm in 150 English-speaking healthy individuals (89 females; MAge = 31.14, SDAge = 7.73). Overall, we did not replicate the suppression-induced forgetting effect (same-probe: BF01 = 7.84; d = 0.03 [95% CI: -0.13; 0.20]; independent-probe: BF01 = 5.71; d = 0.06 [95% CI: -0.12; 0.24]). These null results should be considered in light of our online implementation of the paradigm. Nevertheless, our findings call into question the robustness of suppression-induced forgetting.

Does deception involve more cognitive control than truth-telling? Meta-analyses of N2 and MFN ERP studies.

A number of psychological theories propose that deception involves more cognitive control than truth-telling. Over the last decades, event-related potentials (ERPs) have been used to unravel this question, but the findings are mixed. To address this controversy, two meta-analyses were conducted to quantify the results of existing studies reporting N2 or medial frontal negativity (MFN) associated with deception. In total, 32 papers consisting of 1091 participants were included, which yielded 32 effect sizes for N2 and 7 effect sizes for MFN. We found that deception was associated with a more negative N2 and MFN than truth-telling with medium and large effect sizes (r = .25 and .51, respectively). We also found that the deception paradigm modulated the results (p = .043), but found no evidence for publication bias. Our findings indicate that deception involves more cognitive control than truth-telling. Our review also identifies gaps in this literature, including a need for more ERP studies using spontaneous deception.

The use-the-best heuristic facilitates deception detection.

Decades of research have shown that people are poor at detecting deception. Understandably, people struggle with integrating the many putative cues to deception into an accurate veracity judgement. Heuristics simplify difficult decisions by ignoring most of the information and relying instead only on the most diagnostic cues. Here we conducted nine studies in which people evaluated honest and deceptive handwritten statements, video transcripts, videotaped interviews or live interviews. Participants performed at the chance level when they made intuitive judgements, free to use any possible cue. But when instructed to rely only on the best available cue (detailedness), they were consistently able to discriminate lies from truths. Our findings challenge the notion that people lack the potential to detect deception. The simplicity and accuracy of the use-the-best heuristic provides a promising new avenue for deception research.

Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project.

The low reproducibility rate in social sciences has produced hesitation among researchers in accepting published findings at their face value. Despite the advent of initiatives to increase transparency in research reporting, the field is still lacking tools to verify the credibility of research reports. In the present paper, we describe methodologies that let researchers craft highly credible research and allow their peers to verify this credibility. We demonstrate the application of these methods in a multi-laboratory replication of Bem's Experiment 1 (Bem 2011 J. Pers. Soc. Psychol. 100, 407-425. (doi:10.1037/a0021524)) on extrasensory perception (ESP), which was co-designed by a consensus panel including both proponents and opponents of Bem's original hypothesis. In the study we applied direct data deposition in combination with born-open data and real-time research reports to extend transparency to protocol delivery and data collection. We also used piloting, checklists, laboratory logs and video-documented trial sessions to ascertain as-intended protocol delivery, and external research auditors to monitor research integrity. We found 49.89% successful guesses, while Bem reported 53.07% success rate, with the chance level being 50%. Thus, Bem's findings were not replicated in our study. In the paper, we discuss the implementation, feasibility and perceived usefulness of the credibility-enhancing methodologies used throughout the project.

Diagnosing eyewitness identifications with reaction time-based concealed information test: the effect of observation time.

Eyewitness identification procedures rely heavily on explicit identification from lineups. Lineups have been criticized because they have a considerable error rate. We tested the potential of implicit identifications in a Concealed Information Test (CIT) as an alternative. Previous experiments have suggested that implicit identification procedures might be suited when viewing conditions were favorable. In two experiments, mock eyewitnesses (Ns = 94, 509) witnessed a videotaped mock theft with longer or shorter observation time. We derived eyewitness identifications either implicitly from CIT reaction times or explicitly from simultaneous photo lineups. In Experiment 2, we also manipulated perpetrator presence. In both experiments, the perpetrator-present CIT showed capacity to diagnose face recognition, with large effect sizes (dE1 = 0.85 [0.51; 1.18]; dE2 = 0.74 [0.52; 0.96]), as expected. Unexpectedly, no moderation by observation time was found. In line with our hypothesis, no CIT effect emerged in the perpetrator-absent condition, indicating the absence of recognition (dE2 = 0.02 [- 0.17; 0.20]). We found no compelling evidence that one method would outperform the other. This work adds to accumulating evidence that suggests that, under favorable viewing conditions and replication provided, the RT-CIT might be diagnostic of facial recognition, for example when witnesses are hesitant of making an explicit identification. Future work might investigate conditions that affect performance in one, but not the other identification method.

Countering information leakage in the Concealed Information Test: The effects of item detailedness.

Concealed Information Tests (CIT) are administered to verify whether suspects recognize certain features from a crime. Whenever it is presumed that innocent suspects were contaminated with critical information (e.g., the perpetrator had a knife), the examiner may ask more detailed questions (e.g., specific types of knives) to prevent false positives. However, this may increase the number of false negatives if the true perpetrator fails to discern specific details from its plausible irrelevant controls, or because detailed crime-scene information may be forgotten. We examined whether presenting items at the exemplar level protects against contamination, and whether it compromises the sensitivity in a physiological CIT. Participants (N = 142) planned a mock-robbery, with critical items encoded either at the category or at the exemplar level. The CIT was administered immediately or after a 1-week-delay, with questions phrased at the categorical or exemplar level. There were no effects of time delay. Results revealed that when item detailedness was congruent at encoding and testing, the SCR, HR, and RLL showed larger differential responses, as compared with incongruent conditions. Participants contaminated with crime knowledge at the categorical level did not show a CIT-effect for crime details at the exemplar level, suggesting detailed questions may counter the leakage problem. Asking questions at the exemplar level did not reduce the CIT detection efficiency as compared to asking questions at the categorical level. The importance of congruency between encoding and testing provides examiners with a challenge, as it is difficult to estimate how details are naturally encoded.

Reaction time-based Concealed Information Test in eyewitness identification is moderated by picture similarity but not eyewitness cooperation.

The reaction time-based Concealed Information Test (RT-CIT) has high validity in assessing recognition of critical information. Findings on its usefulness for diagnosing face recognition in eyewitnesses are inconsistent. Experiment 1 (N = 82) tested whether closely matching the faces of the probes and irrelevants, as required for a fair lineup, undermines RT-CIT usefulness. Preregistered Experiments 2a and 2b (Ns = 48), tested the role of eyewitness cooperativeness for RT-CIT validity. All participants watched a mock crime video and then completed an RT-CIT. As expected, the usefulness of the RT-CIT was moderated by picture similarity, with better detection for non-matched faces. Unexpectedly, eyewitness cooperation (conceal vs. reveal recognition), did not affect the validity of the RT-CIT. A large CIT effect observed in Experiment 2b further suggested that-even with matched faces-the RT-CIT might be of use when encoding conditions during the crime were favorable. Cases in which witnesses are unwilling or afraid to make an explicit identification might concern another possible application.

How humans impair automated deception detection performance.

BACKGROUND: Deception detection is a prevalent problem for security practitioners. With a need for more large-scale approaches, automated methods using machine learning have gained traction. However, detection performance still implies considerable error rates. Findings from different domains suggest that hybrid human-machine integrations could offer a viable path in detection tasks. METHOD: We collected a corpus of truthful and deceptive answers about participants' autobiographical intentions (n = 1640) and tested whether a combination of supervised machine learning and human judgment could improve deception detection accuracy. Human judges were presented with the outcome of the automated credibility judgment of truthful or deceptive statements. They could either fully overrule it (hybrid-overrule condition) or adjust it within a given boundary (hybrid-adjust condition). RESULTS: The data suggest that in neither of the hybrid conditions did the human judgment add a meaningful contribution. Machine learning in isolation identified truth-tellers and liars with an overall accuracy of 69%. Human involvement through hybrid-overrule decisions brought the accuracy back to chance level. The hybrid-adjust condition did not improve deception detection performance. The decision-making strategies of humans suggest that the truth bias - the tendency to assume the other is telling the truth - could explain the detrimental effect. CONCLUSIONS: The current study does not support the notion that humans can meaningfully add the deception detection performance of a machine learning system. All data are available at https://osf.io/45z7e/.

A Plea for Preregistration in Personality Disorders Research: The Case of Psychopathy.

In response to a crisis of confidence, several methodological initiatives have been launched to improve the robustness of psychological science. Given its real-world implications, personality disorders research is all too important to not follow suit. The authors offer a plea for preregistration in personality disorders research, using psychopathic personality (psychopathy) as a prominent case example. To suit action to word, the authors report on a preregistered study and use it to help refute common misconceptions about preregistration as well as to illustrate that the key strength of preregistration: transparency outweighs its (perceived) disadvantages. Although preregistration will not conclusively settle the many debates roiling the field of psychopathy and other personality disorders, it can help to verify the robustness of empirical observations that inform such debates.

The Role of Control in Intimate Partner Violence: A Study in Dutch Forensic Outpatients.

Johnson argued that coercive control is crucial in explaining heterogeneity in intimate partner violence, with such violence being more frequent, less reciprocal, and more often male-to-female aggression when it serves to exercise control over the partner. We assessed 280 Dutch forensic outpatients who had recently engaged in intimate partner violence on nonaggressive coercive control. Control showed significant, small to moderate, associations with more frequent past year acts of psychological aggression, physical assault, and sexual coercion and more frequently resulted in partner injury. Control was unrelated to reciprocity of partner violence. High controlling violence was enacted mostly, but not exclusively by men. Overall, while perhaps not having a uniquely strong association, our findings provide partial support for the role of coercive control in intimate partner violence and suggest it may benefit intimate partner violence risk assessment.

Distinguishing true from false confessions using physiological patterns of concealed information recognition - A proof of concept study.

Wrongful conviction cases indicate that not all confessors are guilty. However, there is currently no validated method to assess the veracity of confessions. In this preregistered study, we evaluate whether a new application of the Concealed Information Test (CIT) is a potentially valid method to make a distinction between true and false admissions of guilt. Eighty-three participants completed problem-solving tasks, individually and in pairs. Unbeknownst to the participants, their team-member was a confederate, tempting the participant to break the experimental rules by assisting during an individual assignment. Irrespective of actual rule-breaking behavior, all participants were accused of cheating and interrogated. True confessors but not false confessors showed recognition of answers obtained by cheating in the individual task, as evidenced by larger physiological responses to the correct than to plausible but incorrect answers. These findings encourage further investigation on the use of memory detection to discriminate true from false confessions.